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POISSON REPRESENTATIONS OF BRANCHING MARKOV AND 
MEASURE-VALUED BRANCHING PROCESSES 

By Thomas G. Kurtz^ and Eliane R. Rodrigues^ 

University of Wisconsin, Madison and UNAM 

Representations of branching Markov processes and their measure- 
valued Hmits in terms of countable systems of particles are con- 
structed for models with spatially varying birth and death rates. 
Each particle has a location and a "level," but unlike earlier con- 
structions, the levels change with time. In fact, death of a particle 
occurs only when the level of the particle crosses a specified level r, 
or for the limiting models, hits infinity. For branching Markov pro- 
cesses, at each time t, conditioned on the state of the process, the 
levels are independent and uniformly distributed on [0,r]. For the 
limiting measure-valued process, at each time t, the joint distribu- 
tion of locations and levels is conditionally Poisson distributed with 
mean measure K{t) x A, where A denotes Lebesgue measure, and K 
is the desired measure- valued process. 

The representation simplifies or gives alternative proofs for a vari- 
ety of calculations and results including conditioning on extinction or 
nonextinction, Harris's convergence theorem for supercritical branch- 
ing processes, and diffusion approximations for processes in random 
environments. 

1. Introduction. Measure- valued processes arise naturally as infinite sys- 
tem limits of empirical measures of finite particle systems. A number of ap- 
proaches have been developed which preserve distinct particles in the limit 
and which give a representation of the measure- valued process as a transfor- 
mation of the limiting infinite particle system. Most of these representations 
[5-7, 35] have exploited properties of exchangeable sequences, identifying the 
state of the measure- valued process as a multiple of the de Finetti measure 
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of the sequence, or, as in [35], as a transformation of the de Finetti measure 
of a sequence that gives both a location and a mass for the distinct particles. 

The primary limitation of the representations given for measure-valued 
branching processes in [7] is that the branching rates must be independent of 
particle location. This restriction was relaxed in [31] for critical and subcriti- 
cal branching, but that representation does not seem to provide much useful 
insight and would be difficult to extend to supercritical processes. A second 
limitation of the approach in [7] is that, at least without major additional 
effort, it applies only to models in which the states are finite measures. 

In the present paper, we give another construction which, although similar 
to that of [31], applies immediately to both subcritical and supercritical 
processes (as well as processes that are subcritical in some locations and 
supercritical in others). The construction also applies immediately to models 
with infinite mass. In addition, the new construction seems to be a much 
more effective tool for analyzing the measure-valued processes obtained. 

We introduce the basic ideas of the construction in Section 2, giving re- 
sults for population models without location or type. As in the earlier work, 
the justification for the representation is a consequence of a Markov map- 
ping theorem, Theorem A. 15. The Feller diffusion approximation for nearly 
critical branching processes is obtained as a consequence of the construction. 
Section 3 gives the construction for the general branching Markov process 
and the Dawson-Watanabe superprocess limit. Section 4 gives a variety of 
applications and extensions, including conditioning on nonextinction, mod- 
els with heavy-tailed offspring distributions and processes in random envi- 
ronments. The Appendix contains background material and a number of 
technical lemmas. 

2. Simple examples. In this section, we give particle representations for 
pure death and continuous time Markov branching processes and illustrate 
how the infinite system limit can be derived immediately. The main point 
is to introduce the notion of the level of a particle in the simplest possible 
settings. 

2.1. Pure death processes. For r > 0, let ■?i(0), . . . ,^no(0) be independent 
random variables, uniformly distributed on [0,r]. For 6 > 0, let 

so =e»(0)e^*, and define N (t) = #{i : Ci{t) < r} and = ... , 

^^7V(i))) where the Uj{t) are the values of the ^i{t) that are less than r. The 
Ui{t) will be referred to as the levels of the particles. The level of a particle 
being below r means that the particle is "alive," and as soon as its level 
reaches r the particle "dies." Note that N{t) is the number of particles 
"alive" in the system at time t. 
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Let f{u, n) = nr=i 9{'^i)-> where < (7 < 1, 5 is continuously differentiable 
and g{ui) = 1 for ui > r. [The "n" in f{u,n) is, of course, redundant, but it 
will help clarify some of the later calculations.] Then 

j^f{Uit),N{t)) = AfiU{t),N{t)), 

where 

n 

Af{u,n) = f{u,n)^huig{ui)/g{ui). 

i=l 

Note that Af{u,n) may also be written as 

n 

Af{u,n) = ^buig' {ui)Y\_9{uj). 

i=l j^i 

Hence, even if g{ui) = for some i, the expression for Af{u,n) still makes 
sense. 

Let ar{n,du) be the joint distribution of n i.i.d. uniform [0,r] random 
variables. Setting e~^^ = g{z) dz, f{n) = J f{u,n)ar{n,du) = e~^^^ 

and 

A/(u,ri)ar(n,dii) =ne"^s(""^^6r~^ / zg'{z)dz 

Jo 

= 5ne-^«(""^V^i [\g{r) - g{z)) dz 
Jo 

= Cf{n), 

where 

Cf{n) = bn[f{n-l)-f{n)], 

that is, the generator of a linear death process. Of course, the conditional 
distribution of U{t) given N{t) is just ar{N{t), •). 

Let Tt = cr{U{s) : s < t) and .Ff = a{N{s) : s < t). Then trivially, 

/(C/(0), iV(0)) = f{U{t),N{t)) - f Af{U{s),N{s)) ds 

Jo 

is an {/"t}-martingale, and Lemma A. 13 implies 

E[f{U{t),Nm^n - r E[Af{U{s),N{s))\T^] ds 



fiN{t))- / Cf{Nis))ds 
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is a {J-'/^}-martingale. Consequently, is a solution of the martingale prob- 
lem for C and hence is a linear death process. Of course, this observation 
follows immediately from the fact that t[ defined by Ui{0)e^'^i = r is expo- 
nentially distributed with parameter b, but the martingale argument illus- 
trates a procedure that works much more generally. 

2.2. A simple branching process. For / and g as above, a > 0, r > and 
— oo <b< ra, define the generator 

Arf{u, n) = f{u, n) ^ 2a / {g{v) - 1) dv 
i=i •'^^ 

(2.1) 



n 



We refer to Ui as the level of the ith particle, and as in the pure death ex- 
ample, a particle "dies" when its level reaches r. The process with generator 
(2.1) has the following properties. The particle levels satisfy 

U^{t) = aUKt)-hU^{t), 

and a particle with level z gives birth at rate 2a(r — z) to a particle whose 
initial level is uniformly distributed between z and r. Uniqueness for the 
martingale problems for A^ follows by first checking uniqueness for the op- 
erator D given by the second term alone, and then showing that uniqueness 
holds up to the first time that the process includes n particles by observing 
that Ar truncated at n is a bounded perturbation of D. Finally, the first 
hitting time of n goes to infinity as n — t- oo (cf. Problem 28 in Section 4.11 
of [9]). 

As before, f{n) = f f{u,n)ar{n,du) = e~^^^. To calculate / Ar{fu,n) x 
ar{n,du), observe that 

r~^2a g{z) I {g{v) - I) dv dz = are^"^^^ - 2ar~^ g{z){r-z)dz 
Jo Jz Jo 

and 

rr pr 

r-W {az^ -bz)g{z)dz = -r-^ j {2az - b){g{z) - I) dz 
Jo Jo 

pr 

= -2ar~^ I zg{z) dz + ar + b{e~^<' - 1). 

Then 

Af{u,n)ar{n,du) = ne~^^^"-~^\are~''^^^ -2are~'^^ +ar + b{e^^^ -1)) 
Cf{n), 
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where 



(2.2) Cf{n) = ran{f{n + 1) - /(n)) + (ra - b)n{f{n - 1) - /(n)) 



is the generator of a branchmg process. 

Unhke the hnear death example, it is not immediately obvious that 
ar{N{t), •) is the conditional distribution of U{t) given = a{N{s) :s <t); 
however, Theorem A. 15 and the fact that a solution of the martingale 
problem for C starting from iV(0) exists gives the existence of a solu- 
tion (U{t),N{t)) of the martingale problem for Ar such that for all t>0, 
ar{N{t), •) is the conditional distribution of U{t) given J-^ . To apply Theo- 
rem A. 15, take ip{u^n) = n in (A. 15) and assume -E[A^(0)] < oo. Any solution 
of the martingale problem for C with E[N{Q)\ < oo will satisfy E[N{t)] = 
E[N{0)]e^^, for all t > 0. The moment assumption can be eliminated by 
conditioning. 

We conclude that for any distribution for A^(0), there is a solution (U,N) 
of the martingale problem for A such that is a solution of the martin- 
gale problem for C, that is, is a linear birth and death process with 
birth rate ar and death rate ar — b. Uniqueness holds for the martingale 
problem for A, so for any solution of the martingale problem for A satis- 
fying P{U{0) G r|Ar(0)} = ar{N{0),r), we have that A^ is a solution of the 
martingale problem for C. 

This representation can be used to do simple calculations. For example, 
let i7*(0) be the minimum of Ui{0), . . . , ?7jv(o)- Then for all t, all levels are 
above 



Let T = mi{t:N{t) = 0}. Then if r is finite, U^,{t) = r. In particular, if 
iV(o) = n, then 



Note that the assumption that b <ra ensures that e — ^(e" — 1) > 1. 

In the branching process, the average lifetime of an individual is (ar — b)~^ 
which will be small if r is large. Consequently, it is important to note that 
the levels do not represent single individuals in the branching process but 
whole lines of descent. For example, at least in the critical or subcritical 
case, the individual with level C/*(0) at time zero is the individual whose 
line of descent lasts longer than that of any other individual alive at time 
zero. 



f/*(0)e-' 



l-{a/b)U40){l-e-bi)- 
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2.2.1. Conditioning on nonextinction. If 6 < 0, then conditioning on non- 
extinction, that is, conditioning on r > t and letting t — t- oo, is equivalent 
to conditioning on f/*(0) = 0. Conditioned on C/^,(0) = 0, f/i(0), . . . , f/Ar(o)(0) 
include iV(0) — 1 independent, uniform [0,r] random variables and one that 
equals zero. If one of the initial levels is zero, then the solution of the mar- 
tingale problems for gives a solution for 

n— 1 „j. n— 1 ^ 

^^/(u,n) = /(n,n)^2a / {g{v) -l)dv + f{u,n)Y,{au^^ -buif-r^ 
t=i -^"^ i=i ^^'^'> 

rr 

+ f{u,n)2a / {g{v)-l)dv, 
Jo 

and taking a'^{n,du) to be the distribution of n independent random vari- 
ables, one of which is zero and the others uniform [0,r], we see that is a 
solution of the martingale problem for 

C'fin) = rain + l)(7(n + 1) - /(n)) + (ra -b){n- l)(/(n - 1) - /(n)). 

2.2.2. Conditioning on extinction. If < 6 < ra, then conditioning on ex- 
tinction is equivalent to conditioning on C/*(0) > ^. Conditioned on C/*(0) > 
|, C/i(0), . . . , U]si{Q){Q) are independent uniform r]. Defining Vi{t) = Ui{t) — 
^, y is a solution of the martingale problem for 

fv—b/a 



5>0 



Arfiv, n) = fiv, n) ^ 2a / (^(z) -l)dz + /{v, n)^{avf + bvi) 

1 J Vi ■ 1 



so is a solution of the martingale problem for 

C/(n) = (ra - h)n(J[n + 1) - /(n)) + ran(/(n - 1) - /(n)), 
which is the generator of a subcritical branching process. 

2.2.3. Convergence as t^oo. Again, in the supercritical case, < 6 < 
ra, if < U^{0) < |, then N{t) oo. Observe that 

btrr 



V^oo) = lim e^'U^t) 



t-^oo *^ ' l-(a/6)[/,(0) 

exists, and a similar limit will hold for any level whose initial value is below 
^. Setting ^{t) = X^5e''*i7i{t)i the counting measure S,{t) converges almost 
surely in the sense that 

POO roo 

hm / /(n)e(t,dn)= lim V/(e^*[/,(t))= / /(n)e(oo,dn) 



a.s. 
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for each bounded, continuous, nonnegative / with compact support in [0, oo) 
Let {J't^} be the filtration generated by A^. Then as in (A. 6), 



(2.3) E[e-Io' numt,du)^-pN^^^-F}r-^e-^^Nit)^ 

where 

(rre^^ \ poo 

l-r-^e'^'j (l-e--^("))(iuj (1 - e'-^^")) d^z. 

The left-hand side of (2.3) converges almost surely by Lemma A. 14. Conse- 
quently, 

W = lim e-^*N{t) 



t— >oo 



exists almost surely. Note that > if and only if limj_s.oo ^it) = oo. 

Conditioned on W, ^(oo) is a Poisson point process with intensity r~^W, 
and Ki,(oo) is exponentially distributed with parameter r~^W, with the un- 
derstanding that Ki<(oo) = oo if = 0. It follows that for A > 0, 

P{r-V*(oo) > A|V;(oo) < oo} 

= E[e-^^\W>0] 

= p|r"i[/,(0)(^l-^C/*(0)^ >a|[/*(0)<^ 

If A^(0) = 1, then J7*(0) is uniformly distributed on [0,r], and hence > 
0} = ^ and 

-xw ^ 



^[e-^^liy >0] 



l + (ra/6)A' 



that is, W is exponentially distributed with parameter —. Of course, we 
have simply rederived a classical result of Harris [17]. 

2.3. Feller diffusion approximation. As r — )■ oo, Arf in (2.1) converges 
for every continuously differentiable g such that < g <1 and g{z) = 1 for 
z > rg, that is, for f{u) = Ylig{ui), in the limit 



(2.4) Afiu) = fiu)Y, 2a P ig{v) - 1) dv + f {u)Y,i 

1. 1 



auf — bui) 



If n/r — y as r — oo, then ar{n, •) converges to a{y, •), where a{y, •) is the 
distribution of a Poisson process .^j^ on [0, oo) with intensity y, in the sense 
that 

[0,r]" 
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Note that 

and using Lemma A. 3 

/ /"OO /"OO 

aAf{y) = e~yP^ 2ay / giz) / {g{v) - 1) dv dz 



J {az^ — hz)g\z)dz 
■ e-y^^{2ay g{z) I {g{v)-l)dvdz 



~y {2az-h){g{z)-l)dz 

/ f'OO f'OO 

e~y^H2ay I g{z) {g{v)-l)dvdz 



POO /'OO 

2ay / / {g{v) — l)dvdz 
Jo Jz 



+ hy {g{z)-l)dz 



e~y^^{ayPl-bypg) 

cm, 



where 



Cf{y) = ayf"iy) + byf'{y). 
Again, we can apply Theorem A. 15 taking 

7(tx) = limsup - V l[o,z](^ii) 

I 

and i^iu) = Y^- e~"» , so 

\Af{u)\ < [2arg + \\g'\\{ar1 + \h\rg)Y^ij{u) 

and / ^{u)a{y,du) = y. If y is a solution of the martingale problem for C 

with E[Y{0)] < OO, then E[Y{t)] = e^^E[Y{0)] and the conditions of Theorem 
A. 15 are satisfied. Consequently, there is a solution U of the martingale 
problem for A such that 

(2.5) y(i)=limsup-Vl[o,,](C/i(t)) 

2— >00 Z 
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is a solution of the martingale problem for C with the same distribution as 
Y. [Note that, with probability one, the limsup in (2.5) is actually a limit.] 
If [/ is a solution of the martingale problem for A, then U^{t) = {Ui{t) : 
Ui{t) < r} defines a solution of the martingale problem for Ar. Uniqueness for 
Ar follows by the argument outlined in Section A. 6, and uniqueness for Ar 
implies uniqueness for A. Since uniqueness holds for the martingale problem 
for A, by Theorem A. 15(c), uniqueness holds for C also. In general, if [/ is a 
solution of the martingale problem for A and ^^i^Uiio) is a Poisson random 
measure with mean measure yA, where A denotes Lebesgue measure, then 
(2.5) is a solution of the martingale problem for C. 

2.4. The genealogy and the number of ancestors. For each T > 0, there 
is a solution of 



satisfying UT{t) < oo for t < T and limt^T- urit) = oo. Every particle alive 
at time T is a descendent of some particle Ui (t) alive at time t <T satisfying 
Ui{t) < UT{t). Note that the converse is also true. If Ui{t) < urit), then Ui{t) 
has descendants alive at time T. In fact, a positive fraction of the particles 
alive at time T will be descendants of Ui{t). 

If Y{T) > 0, then there are infinitely many particles alive at time T, but 
since 



they are all descendants of finitely many ancestors alive at time t. Note 
that i — )■ ^(t, [0, nT(t))) is nondecreasing and increases by jumps of +1. It 
is not possible to recover the full genealogy just from the levels since a 
new individual appearing at time t with level v could be the offspring of 
any existing individual with level Ui{t) < v. In Section 3, particles will be 
assigned a location (or type), and if these locations evolve in such a way 
that two particles have the same location only if one is the offspring of the 
other and then only at the instant of birth, it will be possible to reconstruct 
the full genealogy from the levels and locations. 

2.5. Branching processes in random environments. Assume that a and 
b are functions of another stochastic process ^, say an irreducible, finite 
Markov chain with generator Q. Then, for functions of the form f{l,u,n) = 
/o(0/i(^) = /o(0 nr=i ffC^i)) consider a scaled generator 



(2.6) 



UT{t) = auxit)^ — buT{t) 



^{t,[0,UT{t)))<OO 




n 



+ f{l,u,n)Y,{a{l)ul - V^b{l)ui) 



i=l 
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which, as in (2.2), corresponds to a process with generator 

Crf{l,n)=rQf{l,n)+a{l)rn{f{l,n + l)-f{n)) 

+ (ra(0 - V^b{l))nifil,n- 1) - f{l,n)), 

where f{l,n) = /o(/)e-^9". The process corresponding to Cr is a branch- 
ing process in a random environment determined by ^. Writing the process 
corresponding to Ar as 

(e(rt),[/i(t),...,C/;v.(t)) 

the process corresponding to Cr is {S,{rt), Nr{t)). 
Note that in this example, the levels satisfy 

iliit) = a{i{rt))UKt) - V^b{art))Ui{t). 

Let TT be the stationary distribution for Q, and assume that TT{l)b{l) = 0. 
Then, by Theorem 2.1 or [3], for example, 



converges to a Brownian motion Z with variance parameter 

J]vr(A:)gfcK/io(0 - hoik)f = -2 7r(0/io(0&(0 = 2c, 

k I I 

where ho{l) is a solution of QhQ[l) = h{l). In the limit, by Theorem 5.10 of [33] 
(applying a truncation argument to extend the boundedness assumption), 
the levels will satisfy 

(2.7) dUi{t) = {aUi{tf + cUi{t))dt + V2dUi{t) dW{t), 

where o = ^7r(/)a(/). 

Applying ideas from [28], we can obtain convergence for the full system 
by considering the asymptotic behavior of the generator. Setting 

hi{l,u,n) = ho{l)fi{u,n)y^^Ui , \ . 



.=1 9[u.) 



we have 
Ar(fi + -T^hi ]{l,u,n) 



g{ui) 



■ h{u,n)Y,2a{l) / {g{v)-l)dv + h{u,n)Y,a{l) 

■ 1 Uj ■ ^ 

1=1 ^ 1=1 

+ ±ho{l)h{u, n) ( I 2a{l) f {g{v) - 1) dv 
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+ —=^hQ{l)fi{u,n) I vg'{v)dv 

1 " 
+ -i=hG{l)fi{u,n)^{a{l)u] - ^/rh{l)uj) 

i=i 

g'{ui)g'{uj) g'{uj) +Ujg"{uj] 



^ * g{ui)g{uj) g{uj] 
and passing to the limit as r — t- oo, Ar{fi + -^hi) converges to 
Afi{u,l) 

= hiu) 2a{l) Higiv) - 1) dv + h{u) a{l)-''^' ^''''^ 



9{ui) 

I. f ^\^f\^ 9'iui)g'{uj) , Ujg'{uj)+u]g"{uj) ^ 



Finally, we can find an additional perturbation /12 so that Ar{fi + "^^1 + 
i/i2) converges to 



/•oo 

Ah{u) = h{u)Y,'^a / {g{v)-l)dv + h{u)Y, 



- 29' {Ui) 
aUi — — - 

9{ui) 



This convergence assures convergence of the finite models to an infinite par- 
ticle model. The particle birth process is the same as in Section 2.3, but the 
levels satisfy (2.7) where the Brownian motion W is the same for all levels. 
Let a and f3g be as in Section 2.3, and note that 

^9= {'^-9{z))dz= I zg{z)dz 
Jo Jo 



z^g' {z) dz. 







1 

~ ~2 

We have from Lemma A. 3 

(/•oo /'OO 
lay g{z) j {g{v)-l)dvdz 

POO 

+ y I {az^ + cz)g' {z)dz 
Jo 
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(poo \ 2 I'oo \ 

zg'{z)dz\ +cy z^g"{z)dz 

cm, 



where 



Cf{y) = {ay + cy^)f"{y) + cyf'{y), 

which identifies the diffusion hmit for r~^Nr. 

Theorem A. 15 can be extended to cover models with non-Markovian en- 
vironments, that is, the process ^ is specified directly rather than through a 
generator. The diffusion limit is then obtained by verifying convergence of 
the level processes and applying Theorem A. 12. 

For early work on diffusion approximations for branching processes in 
random environments, see [18, 26, 29] and also [9], Section 9.3. 

3. Representations of measure-valued branching processes. 

3.1. Branching Markov processes. We now consider particles with both 
a level Ui and a location Xi in a complete, separable metric space E. Since 
the indexing of the particles is not important, we identify a state (x, u, n) of 
our process with the counting measure ^i[x,u) = SILi ^{xi,Ui) - Let 

n 
i=l 

where g:E x [0, oo) — )■ (0, 1]. We assume that as a function of x, g is in the 
domain T>{B) of the generator of a Markov process in E, g is continuously 
differentiable in u and g{x,u) = 1 for u>r. We set 

A ff \ ff •.•sr^ Bg{xi,Ui) 

Arf{x, u, n) = f{x, u, n) > — 

^ g{xi,Ui) 

(3.1) + f{x,u,n)^2a{xi) {g{xi,v) - 1) dv 

+ f{x, u, n) y^{a{xi)u} - b{x.i)u.i) ^^^9{xi,Ut) ^ 

Each particle has a location Xi(t) in E and a level Ui{t) in [0,r]. The loca- 
tions evolve independently as Markov processes with generator B; the levels 
satisfy 

(3.2) U,{t) = a{Xi{t))Uf{t) - b{Xi{t))Ui{t); 
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particles give birth at rates 2a{Xi(t)){r — Ui{t)); the initial location of a new 
particle is the location of the parent at the time of birth; and the initial level 
is uniformly distributed on [Ui{t),r]. Particles that reach level r die. Setting 

calculating as in Section 2.2, we have 

n n 

Crf{x,n) = ^B^J{x,n) + ^ra{xi){f{h{x\xi),n + l) - f{x,n)) 

i=l i=l 
n 

+ ^{ra{xi) - b{xi)){f{d{x\xi),n- 1) - f{x,n)), 

i=l 

where B^^ is the generator B applied to f{x,n) as a function of Xi, b{x\xi) 
is the collection of n + 1 particles in E obtained from x by adding a copy of 
the ith particle Xj, and d{x\xi) is the collection of n — 1 particles obtained 
from X by deleting the ith particle, that is, if fix denotes , then for 

z€E, 

n n 
i=l i=l 

If ra{z) — b{z) > for all z £ E, then C is the generator of a branching 
Markov process with particle motion determined by B, the birth rate for a 
particle at z £ E given by ra{z) and the death rate given by ra{z) — b{z). 

With Theorem A. 15 in mind, we make the following assumptions on B, a, 
b and r. C{E) is the space of continuous functions on E, C{E) the space of 
bounded continuous functions on E and M{E) the space of Borel measurable 
functions on E. 

Condition 3.1. 

(i) B C C{E) X C{E), T){B) is closed under multiplication and is separat- 
ing. 

(ii) f £'D{A) satisfies /(x,u,n) = n"=i5(a^j,^ij), where = ni^i(l - 
g\{z)g2{v)) for g\ G V{B), g\ differentiable with support in [0,r] and 
< g\{z)g\{v) < Pg <l for all /, z and v. 

(iii) There exists ipB £ C{E), ipB > and constants Cg > 0, for each g in (ii), 
such that 

sup\Bg{x,u)\ < Cgipsix), x£E. 

u 

(iv) Defining Bq = {{g,{TpB V 1)^^ Bg) : g G V^B)}, Bq is graph separable 
(see Section A. 5). 

(v) a, b£ M{E), a>0, r >0 and ra-b>0. 
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We have the following generalization of the results of Section 2.2. 
Theorem 3.2. Assume Condition 3.1. For x £ and u £ [0,oo)", let 

n 

^l;{x, u) = l + ^(^B(xi) + aixi) + |6(xi)|)e-"^ 

i=l 

and 

n 

ip{x) = 1 + Y.i'^sixi) + a{xi) + \b{xi)\){l - e-''). 
1=1 

If X is a solution of the martingale problem for C satisfying 
ft 



(3.3) E 



ip{X{,s))ds 







< oo for all t>0, 



then there is a solution {X,U) of the martingale problem for such that 
X and X have the same distribution. 

Remark 3.3. For many models, tpB, cl and b will be uniformly bounded, 
and the moment conditions (3.3) will hold as long as £'[X(0)] < oo. 

Proof of Theorem 3.2. Note that 

\Arfix,u,n)\ < {2r + {1 + r^ + r)dg)e'''ip{x,u), 

where dg depends on the g[, g\., d^g^ ^^^^ -^Hfi'i'' ^ choices of {/i, . . . , lj\ C 
{1, . . . ,m}. The result then follows by application of Theorem A. 15. □ 

Theorem 3.2 applies to finite branching Markov processes. Similar results 
also hold for locally finite processes. 

Theorem 3.4. In addition to Condition 3.1, assume that 

oo 

\g{x, u) — l\du + sup(u + u^) dug{x, u) < CgtpBix). 

u 
For X G E°° and u G [0, oo)°° , let 

oo 

'ip{x,u) = 1 + ^i^Bixi){l + a{xi) + |6(xi)|)e-"' 

i=l 

and 

oo 

i^ix) = 1 + J^^b(x,)(1 + a{xi) + \b{x,)\){l - e-'). 

i=l 
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If X is a solution of the martingale problem for C satisfying 



(3.4) E 



ip{X{s))ds 







< oo for all t>0, 



then there is a solution {X,U) of the martingale problem for such that 
X and X have the same distribution. 

Proof. Note that 

Arf{x,u,n) < 2cge^ilj{x,u). 
The result then follows by application of Theorem A. 15. □ 

Example 3.5. Suppose that a and b are bounded, and i? is a diffusion 
operator with bounded drift and diffusion coefficients. Then we can take 
T>{B) to be the collection of nonnegative C^-functions with compact support 
and Tpsiz) = ^^^^\^2y , for /3 > 0. If -EEj i^BiXiiO))] < oo, then there exists a 
solution of the martingale problems for C satisfying sup<,<^ ^lYli i^BiXils))] < 
oo and hence E[fl^il;{X{s)) ds] < oo. 

3.2. Basic limit theorem. As in Section 2.3, if r — t- oo, Af given by (3.1) 
becomes 

Aff \ f( .^r^ Bg{xi,Ui) 

Af{x, u) = f{x, u) > — 

^ g{xi,Ui) 

(3.5) + f{x,u)'^2a{xi) {g{xi,v) - I) dv 

+ f{x,u) } {a{xi)Ui -b{xi)Ui) — — , 

^ g{xi,Ui) 

where g:E x [0,oo) — )• (0, 1] has the property that there exists rg such that 
g{z,v) = 1 for u > rg, and f{x,u) = Yl^g{xi,Ui). We can identify the state 
space of the corresponding process with a subset of {E x [0,oo))°° or, since 
order is not important, with a subset of M{E x [0,oo)), the counting mea- 
sures on X [0,oo). Define 

Mf{E X [0,oo)) = {i^eM{E X [0,oo)):/i(^ x [0, n]) < oo VO < u < oo}, 

where the topology for Nf{E x oo) is given by the requirement that /i„ — )• /i 
if and only if J f d^n f f dfj, for all / € C(S x [0, oo) for which there exists 
Uf > such that f{x,u) = for tt > Uf. (See Section A. 3 for a discussion of 
the appropriate topology to use in the infinite measure setting.) 
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As r — 7- oo, the particle process converges to a process in which parti- 
cle locations evolve as independent Markov processes with generator B, 
levels satisfy (3.2), a particle with level Ui{t) gives birth to new particles 
at its location Xi (t) and level in the interval [Ui (t) + c, Ui (t) + d] at rate 
2a{Xi(t)){d — c). A particle dies when its level hits oo. The level of a parti- 
cle born at time Iq (or in the initial population, if to = 0) with initial level 
Ui{to) satisfies 



1 - U,{to) fl e- ^"o ''(^^(^))'^^a(X,(^)) dv ' 

until it hits infinity. If 6 < and a is bounded away from zero, then Ui will 
hit infinity in finite time. 

If we extend the path Xi back along its ancestral path to time zero, we 
would have 



1 - no /o e" /o Kx^is)) ds^(^Xi{v)) dv ' 

where uq is the level of the particle's ancestor at time zero, and Xi{s) is 
the position of the ancestor at time s <t. Since we are assuming that the 
initial position of an offspring is that of the parent, Xi is a solution of the 
martingale problem for B. 

Proposition 3.6. Let {X,U) be a solution of the martingale problem 
for A given by (3.5). Let (X'', U"') consist of the subset of particles for which 
Ui < r, that is, 

Lf a{z)r — b{z) > for all z £ E, then {X^,U'^) is a solution of the martingale 
problem for A.^ given by (3.1). 

Remark 3.7. The condition a{z)r — b{z) > for all z G ensures that 
any particle that is above level r at time t will stay above level r at all future 
times. 



Proof of Proposition 3.6. The proposition follows by the observa- 
tion that Ar can be obtained from A by restricting the domain to f{x,u) = 
Y\ig{xi,Ui) for which g{z,v) = 1 for v>r. □ 
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3.3. The genealogy. Assume for the moment that a and b do not depend 
on X. If the location process has the property that at the time of a birth 
only the offspring has the same location as the parent (e.g., if the location 
process is Brownian motion), then the full genealogy can be recovered from 
knowledge of the levels and locations. The collection of ancestors at time 
t < T of the particles alive at time T is {{Xi{t), Ui{t)) : Ui{t) < UT{t)}, where 
UT{t) is given by (2.6). The number of particles in this collection is non- 
decreasing in t and increases only by jumps of +1. The parent of the new 
particle is identifiable by the fact that only the parent and the offspring will 
be at the same location. 

If a and b depend on x, the full genealogy is still determined by the 
locations and levels of the particles, but recovering the genealogy is more 
complicated since it may not be possible to tell whether or not a particle 
{Xi(t), Ui{t)) has descendants alive at time T > t just from information avail- 
able at time t. However, some easy observations can be made. For example, 
if infx a{x) > and sup^. b{x) < oo, then for t <T, all particles alive at time 
T are descendants of finitely many particles alive at time t. 

3.4. The measure-valued limit. The generator for a Dawson-Watanabe 
superprocess is typically of the form 

Cf{fi) = exp{-{h,fi)} [ {-Bh{y)-F{h{y),y))fi{dy), 

for /(yu) = exp{— (/i, fj,)}, where {h, fi) = h{y)fi{dy) and h is an appropriate 
function in T)[B) (see, e.g.. Theorem 9.4.3 of [9]). For superprocesses arising 
from branching models with offspring distributions having finite variances, 
F should be of the form F{h{y),y) = —a{y)h{y)'^ + b{y)h{y). 

For ^ € Mf{E), let a{(i,dx x du) be the distribution of a Poisson ran- 
dom measure on x [0,oo) with mean measure fix A. Then setting h{y) = 
/o°°(l -5'(y,^'))dv, 



f(^) = af{fi)= / f{x,u)a{iJ,,dx X du) 



exp<{ ^^y^ {g{y,v) -l)dv n{dy) 



= exp{-{h,n)}. 
Using Lemma A. 3, we have 



aAf{n)= / Bg{y,v)dvfi{dy)exp{-{h,n)} 
Je Jo 

{9iy,v) - l)dvdzn{dy)exp{-{h,fi)} 
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EJO 



+ 11 {a{y)v -b{y)v)dyg{y,v)dv fj,{dy)exp{-{h,fi)} 
Je Jo 

Bg{y, v) dv fi{dy) exp{-(/i, /z)} 

roo 

'^a{y)g{y,z) / {g{y,v) - l)dvdz ij{dy)exp{-{h,fi)} 

J z 

{2a{y)v -h{y)){g{y,v) - l)dv^x{dy) exp{-(/i,^)} 



+ 



EJO 



EJO 

oo 

Bg{y, v) dv ^{dy) exp{- (/i, ^u)} 



+ / / '^a{y)g{y,z) {g{y,v)-l)dvdzfi{dy)exp{-{h,i^)} 

J EJO Jz 

o poo 

2a(y) / {g{y,v) -l)dvfi{dy)exp{-{h,fi)} 




E Jo 



+ 11 b{y)i9{y,v)-l)dvn{dy)exp{-{h,fi)} 

JE JO 




oo 



E Jo 



Bg{y, v) dv fi{dy) exp{-{h, n)} 



r roc 

+ Ky)i9iy,v) -l)dvfi{dy)exp{-{h,ij,)} 



EJO 

E 



{-Bh{y) + a{y)h{yf - b{y)h{y))^i{dy)exv{-{h,^l)] = Cfifj.). 



But C is the generator for a superprocess, so for each /x G Mf{E), there 
exists a solution Z of the martingale problem for C with Z{0) = fi and hence 
a solution (X, U) of the martingale problem for A with initial distribution 

The mapping ^■.J\ff{E x [0, oo)) — )■ Mf{E) used in the application of The- 
orem A. 15 is given by 

Y ^ 

lim — > 5x ■, if the measures converge 

s>oo r ^ — ' ' 

ui<r in the weak topology, 

, ^0) otherwise, 



where /xq is a fixed element of Aif{E). The solution ^^{Xi{t),Ui{t)) of the 
martingale problem for A is a conditionally Poisson random measure (see 
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Section A. 2) with Cox measure Z{t). Consequently, the particles determine 
Zhy 

(3.6) Z{t)= lim - V 6x,it)- 

U,{t)<r 

Since by Proposition 3.6 and Theorem 3.2, Z^{t) = ^J2ui{t)<r^x^{t) is 
the normalized empirical measure for a branching Markov process, (3.6) 
gives the convergence of the normalized branching Markov process to the 
corresponding Dawson- Watanabe superprocess (cf. [4, 49]). 

4. Examples and extensions. 

4.1. A model with immigration. The simplest immigration process as- 
sumes that the space-time point process giving the arrival times and loca- 
tions of the immigrants is a Poisson process. Assuming temporal homogene- 
ity, immigration is introduced by adding the generator of a space-time-level 
Poisson random measure. Let z/ be the intensity of immigration, that is, 
iy[A)At is approximately the probability that an individual immigrates into 
^ C -B in a time interval of length At. The generator becomes 

Af{x, u) = fix, u) > — 

^ g{xi,Ui) 

+ f{x:u)^2a{xi) j {g{xi,v)-l)dv 

+ f{x,u) I I {g{z,v) -l)u{dz)dv 
Jo J E 

du^g{xi,Ui) 



+ f{x, u) ^(a(xi)ui - b{xi)ui) ■ 



g{xi,Ui) 



Noting that the generator for finite r is obtained from A by restricting the 
domain to the collection of g with rg < r, if ra{x) — b{x) > 0, for all x, the 
generator of the corresponding branching Markov process with immigration 
is 



Crf{x,n) = ^B:^J{x,n) +^ra{xi){f{b{x\xi),n+l) - f{x,n)) 

i=l 1=1 
n 

+ '^{ra{xi) -b{xi)){f{d{x\xi),n- 1) - f{x,n)) 

i=l 

{f{b{x\z),n+l) - f{x,n))u{dz). 
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For r = oo, setting h{x) = /o°°(l — 9{x,v)) dv as before, the generator for 
the measure-valued process is 

Cf{n) = aAf{fi) = {{-Bh + ah'^ -bh,^j,) - {h,u)) eiip{-{h, fi)}, 

for /(/i) = exp{-(/i,^f)}. 

Early results on branching Markov processes with immigration include 
[19, 27]. Work on limiting measure- valued processes with immigration in- 
cludes [8, 37-39, 48]. 

4.2. Conditioning on nonextinction. In the limiting model considered in 
Section 3.2, let a and b be constant and 6 < 0. Let r be the time of extinction 
and let ?7*(0) be the minimum of the initial levels. Then r is the solution of 
l-t^*(0)f(l-e-''^) = 0, so 

__1 U^{Q)a-b 

^~ b°^ U,{0)a ■ 

If Z{0) =/iO) then C/*(0) is exponentially distributed with parameter ^q{E) 
and 

a(l-e-^^)i ^ ^^^^1 a{l-e-bTy 

The case 6 = is obtained by passing to the limit so that P{t > T} = 
l-exp{-;Uo(^)/(aT)}. 

As in Section 2.2.1, conditioning on {r > T} and letting T— )• oo is equiv- 
alent to conditioning on the initial Poisson process having a level at zero. 
The resulting generator becomes 

Af{x, u) = f{x, u) > — 

^ 9{xi,Ui) 

+ f{x,u)^2a {g{xi,v)-l)dv 

(4.2) 



P{r >T} = P{ UM < -r. TirT = 1 " exp 



+ f{x, u)2a / {g{xo,v) - 1) dv 
Jo 

I r/ \ ^ 2 T ^duig{Xi,Ui) 
+ f[x, u) y [aui - bui) — r— , 

Ui>0 

where the Ui are the nonzero levels, and the generator for the conditioned 
measure-valued process is given by setting 



"o/(^f) = J f{x,u)ao{fi,dx X du) 

= rr / 9{z,0)n{dz)exp{-{h,fi)} 
l/^l Je 
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and 

\2 



aoAfifx) = {-Bh{y) + ah{yY - b{y)h{y),fi) 

^ A / 9{z,0)fi{dz)exp{-{h,i.i)} 



\W Je 

+ [ {Bg{z,0) - 2agiz,0)h{z))fi{dz)exp{-{h,f,)}. 
Je 

Note that oq is the distribution of ^ = (5o,Zo + Yli^i ^(Ui^Zi)-, where {Ui,i > 
1} is a Poisson process with intensity niE), and Zq,Zi,... are i.i.d. with 
distribution fi{-) / fj.{E) . 

For earher work, see [10, 12, 20, 36, 40]. In particular, the particle at level 
zero in the construction above is the "immortal particle" of Evans [10]. 

4.3. Conditioning on extinction. As in Section 2.2.2, if a and b are con- 
stant and 6 > 0, then conditioning on extinction is equivalent to conditioning 
on f/*(0) > K Defining Vi{t) = Ui{t) — ^, the generator for the conditioned 
process is 

(4.3) +f{x,v)Y,'^aj\g{x,,v)-l)dv 

I f( \S^( 2 7 ^dvig\Xi,Vi) 
+ f{x,v)y{avi -hvi) — — , 

^ g{x^.Vi) 

and the generator of the measure- valued process is 

C?{IJ)= I {-Bh{y) + ah{yf + bh{y))f,{dy)exp{-{h,fi)}, 



for /{(i) = exp{ — (/i, /i)}. In other words, conditioning a supercritical process 
on extinction replaces the supercritical process by a subcritical one. This 
result is originally due to Evans and O'Connell [11]. 



4.4. Models with multiple simultaneous births. We now consider continuous- 
time, branching Markov processes with general offspring distributions. The 
general theory of branching Markov processes was developed by Ikeda, Na- 
gasawa and Watanabe in a long series of papers [21-24] following earlier 
work by several authors. The particle representation is substantially more 
complicated and passage to the infinite population limit more delicate. 
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As above, the particles move independently in E according to a generator 
B. A particle at position x £ E with level u gives birth to k offspring at rate 

{k + l)a^i^\x){r — u)^r~^^~^\ New particles have the location of the parent, 
but their levels are uniformly distributed on [u,r). Then for f{x,u,n) = 
U7=i9{xi,Ui), 

Arf{x,u,n) 



f{x,u,n) > — 7 r- 

9{xi,Ui) 



+ f{x,u,n)'^Y^ 

i=l k=l 



{k + l)a'[\x,) 



(4.4) 



VI 



\i=i 



dvi ■ ■ ■ dvk 



n / oo 



+ f{x,u,n)^{ ^r'^a(^{xi) 



i=i \k=i 



Ui 



k+l 



+ + 

r 



Now, the levels satisfy the equation 



(4.5) 



k=l 



k+l 



b{xi)ui 



1 + ik + l) 



g{xi,Ui) 



b{X,{t))U,{t). 

Defining g{x) = ^ /q g{x, v) dv and integrating (4.4) with respect to a(n, du), 
the uniform measure on [0,r]", we have that 

Crf{x,n) 

Bg{xi) 



(4.6) 



f{x,n)^- 



i=l 



g{xi 



+ /(x,n)^^r4^-)(x,)b(x,)'-l] 



1=1 k=l 
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i=i \ k=i / 
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1 



which is the generator of a branching process with multiple births with 

birth rates ra^^^(-), death rate r X^^Li ^(^t^ (.') ~ H') (provided this expression 
is nonnegative) and particles moving according to the generator B. The 

analog of Theorem 3.2 holds with a{xi) replaced by '^f.{k + l)a^^\xi) in the 
definition of ip and 
We define 

oo r / \ k-\ 



k=l 



1- 

r 



and assume that 

lim A(^-)(, 



(4.7) 



lim '^^r{k -\- l)a^i^\x 



k=l 



E(0(-)"(7)' 



A(x, u) 



exists uniformly for x £ E and u in bounded intervals. This condition is 
essentially (9.4.36) of [9]. 
Observe that 



/ A^'\x,v)dv = Y,r^4\^) 
■^0 k=l 



1 



u 



k+1 



1 + (A; + 1) 



so that (4.5) becomes 



(4.8) 
and 



A^'\Xi{s),v)dv-b{Xi{t))U,{t) 



r A^'''>{x,v)dv = Y]r^ka^'^^< 
•^0 k=l 



so that the death rate for the branching process can be written as r ^ A^^^ (a 
v) dv — b{x). 
As in [31], 

am 

d'^A^'^\x,u) = ^A^'-\x,u) 
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(4.9) ={-ir^'E^t\ 



(r), ,{k + l)k---{k- 771 + 1) 
' X] ; 



k=m 

(\ k—m 
r 

Each of the derivatives is a monotone function of u, and since 
5™-1aW(x,6) - a™-^A('')(x,a) 

J a 

it follows by the convergence of A^''^ and induction on m that each d"'A^''\x,u) 
converges uniformly in u on bounded intervals that are bounded away from 
zero. Consequently, A is infinitely differentiable in u, and for < ui < 

U2 <00, 

lim sup \d"'A^''\x,u)-d'^A{x,u)\=0. 

The fact that the derivatives alternate in sign implies that d^A[x,-) is com- 
pletely monotone and hence can be represented as 

POO 

d^A{x,u)= / e-'''d{x,dz) 



for some u-finite measure i'{x,-). Writing z?(x,-) = 2ao(x)(5o + I'ix,-) with 
z^(x,{0})=0, 

/•oo 

A{x,u) = 2ao{x)u+ / - e~"^)z^(a:, dz). 

Jo 

Let g satisfy g{x,v) = 1, ior v > Ug, and define 

h{x,u)= / [1 — g{x,v)) dv. 

J u 

li r > Ug and there are n particles below level r, then (4.4) may be written 
as 

Arf{x,u,n) 

= fix,u,n)±^p^ 
^ g{xi,Ui) 

+ f{x,u,n) 

n oo 



n oo 

X 

i=l k=l 
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g{xi,Ui) 



Then, by (4.7) and the definition of h, we have 
Afix,u) 

= hm Arf{x,u) 

^ g{xi,Ui) 
+ f{x,u)'^{A{xi,Ui) - A{xi,Ui + h{xi,Ui))) 

i 

+ /(x, u) V ( r A{x,,v) dv - b{x,)u,) ^2^,9^12^ 

=f{x,u)y^^^^^ 

^ g{xi,Ui) 

igixi,v) - l)dv 

i Jo 

+ f{x, u) ^ ( ao{xi)uj - b{xi)ui 

i ^ 

I -1/ -1/1 -Uiz\\ I 1 \ \ duig{xi,Ui) 
+ z [Ui-z (1-e '))u[Xi,dz)] — — . 

Jo ) g{xi,ui) 

Note that the second term on the right-hand side has the same interpretation 
as the second term on the right-hand side of (3.5). To understand the third 
term, recah that if ^ = '^^i^n is a Poisson process on [0,oo) with parameter 
A, then 



Consequently, the third term determines bursts of simultaneous offspring at 
the location Xi of the parent and with levels forming a Poisson process with 
intensity z on [iij,oo). 
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Setting h{x) = h{x,0) = /q°°(1 — g{x,v)) dv and /(//) = exp{— (/i,/^)}, 
Cm = aAf{^i) 



h{y) 



A{y,z)dz - b{y)h{y) ] n{dy)exp{-{h, i^l)}. 



-Bh{y) + 



Based on the above calculations, we have the following theorem. 

Theorem 4.1. Let B C C{E) x C{E) satisfy Condition 3.1, and let the 
martingale problem for B he well posed. Assume that for r > rQ, 



inf (r V ka'('' {x) - b{x) \ > 
^ fc=i ^ 



and that the convergence in (4-'^) is uniform in x. Let K{Q) be a finite 
random measure on E, and let be a solution of the martingale problem for 
Ar such that £,^'(0) is conditionally Poisson on E x [0,r] with mean measure 
-fC(O) X A. Then ^'^ ^ ^ where ^ is a solution of the martingale problem for 
A. 

Proof. For r>q, let ^(9)''' denote the restriction of to £' x [0, q] and 
similarly for It is enough to prove that =^ for each q > tq. The 
generator for is the restriction of A^ to functions / € T>{Ar) such that 
the corresponding g satisfies g{x,u) = 1 for u> q. For / of this form, by 
(4.9), Ar^qf = Arf Satisfies 



Ar^qf{x,u,n) 



Bg{xi,Ui) 



f{x,u,n)y] 

^ g{xi,Ui) 

n oo ^ 

+ /(x, n) ^ ^ — (-ir+^a™ AM (x„ (?) 
^-^ ml 



1=1 m=l 



Vl) 



\l=l 



dvi ■ ■ ■ dVr, 



i=l 



+ f{x,u,n)'^( / A^'^\x,v)dv -b{xi)ui 



du,gixi,Ui) 
g{xi,Ui) 



and the corresponding branching Markov process has generator 



Cr,qf{x,n) 
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1 9{xi) 



n oo ^ 
i=l m=l ^ ^ 

+ /(x, n)Yj^^j^^ AM {xi ,v)dv- b{xS 



g{xi) 

The convergence of C^'?)''^ follows by the convergence assumptions on A^''). 
□ 

The measure i'{x,-) is nonzero only if the offspring distribution has a 
"heavy tail." If ai^\x) = ak{x) and 



+ l)kak{x) < oo, 



fe=i 



then 



A{x, u) = lim r{k + 1) 



ak{x) 



k=l 



1- 1 



u 



k=l 



and 



A/(x,n) = f{x,u)^ 



Bg{xi,Ui) 
g{xi,Ui) 



+ /(x,u)^^(/c + l)A;afc(xi) / [5f(xi, u) - 1] cif 
j fc=i 

/ oo 

+/(^>^)E(E 2 



{k+l)kak{xi) 2 s \ 5t,^5'(a;i,'Ui) 



j \fc=i 



g{xi,Ui) 



which is essentially (3.5). 

For scalar branching processes with general offspring distributions, con- 
vergence to possibly discontinuous continuous state branching processes was 
proved by Grimvall [16] (see [9], Section 9.1). Convergence in the measure- 
valued setting is given in [49] and [4] for offspring distributions with finite 
second moment and more generally in [9], Theorem 9.4.3. Fitzsimmons [13] 
gives a very general construction of these processes. 

If u is not zero, then the genealogy of the process is much more compli- 
cated than that described in Sections 2.4 and 3.3. Assume that A and b do 
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not depend on x, and define 

A(n) = / A{v) dv - bu = 2aou^ - bu + / - 1 + e"'"^)i/(dz). 

Jo Jo 

If ut satisfies 

UT{t) =A{uT{t)), 

urit) < oo for t <T and lim^^j.^-^ UT{t) = oo, then it is still the case that 
the collection of ancestors at time t < T of the population alive at time 
T is {{Xi{t),Ui{t)) :Ui{t) < UT{t)}, but ut niay not exist. In fact, since if 
it = A(n) 

ru{t2) 

dv = t2-ti, 

u{ti) A{v) 

Ut exists if and only if 

— dv < oo 

Aiv) 

for u sufficiently large, which always holds if ao > 0. In the critical and 
subcritical cases, this condition is equivalent to extinction with probability 
one as was noted by Bertoin and Le Gall ([2], page 167). 

This finite ancestry property or coming down from infinity of the geneal- 
ogy has been studied for a variety of population models. See [47] and [1] for 
results in the Fleming- Viot setting. The equivalence of the conditions for 
Fleming-Viot and Dawson-Watanabe processes is given in ([2], page 171). 

The argument in Section 2.2.3 can undoubtedly be extended to the present 
setting. This development will be carried out elsewhere. 

4.5. Model with exponentially distributed levels. The discrete models that 
we have considered have been formulated with levels that are uniformly dis- 
tributed on an interval. That is not necessary, and other distributions may 
be convenient in other contexts. We illustrate this flexibility by formulating 
a model for a simple branching process with levels that are exponentially 
distributed. The dynamics of the levels change, and the correct dynamics 
are determined by essentially working backwards from the answer. 

As before, let f{u,n) = YYi=ig{ui) where < g <1 and g{ui) = 1 for 
Ui>Ug. Let 



Arf{u,n) = f{u,n)Y,^a / e-^^/'' {g{v) - I) dv + f{u,n)Y,G^ 

.■1 J U i ■-, 



.-1 ^^'^'^ 

where Gr will be determined below. Note that a particle at level Ui is giving 
birth at rate 2are~'"'/^, and the levels satisfy 

U,it)=GriUi{t)). 
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Let ar{n,du) be the distribution of n independent exponential random vari- 
ables with mean r, and define e~^3 = 9{v)^~^^^ dv so 



fin) = J f{u,n)ar{n,du)=e 
To calculate J Arf{u,n)ar{n,du), observe that 

r~^2a e-'/'g{z) e-""/' {g{v) - I) dv dz 

Jo Jz 

POO 

= are-^^^ - 2a / e-^'/''g{z) dz, 
Jo 

and assuming Gr(0) = 0, 

/•oo 

r^i / e^'/''Griz)g'iz)dz 
Jo 

POD 

= -r-' / e-^/'^{G:.{z)-r-'Gr{z)){g{z)-l)dz 
Jo 

POO 

= -r-i / e~'/''{GUz)-r~'Gr{z))g{z)dz 
Jo 

POO 

+ r-W e-'/'{G'^iz)-r-'^Griz))dz. 
Jo 

Then for 

G;(z) - r-^Gr{z) = e"/"^(e-"/'^G,(z)) = 2ar(l - e""/") - b, 
we have 

e-'/''Gr{z) = 2ar(^r{l - e'^/"^) - ^(1 - e-^^/'')^ - br{l - e"^/'') 

and 

Arf{u, n)ar{n, du) 

: „e -As(n~i) (^are-2^« - / e-'''' {G',{z) - r~'^Gr{z) 

+ 2are~''/'')g{z) dz 
+ r-^ I e-'/'{G',{z)-r^^Gr{z))dz 

Crf{n), 
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where 

(4.10) Crf{n) = ran(f{n + 1) - /(n)) + (ra - h)n{f{n - 1) - /(n)) 

is the generator of a branching process. 

Note that as r — ?• oo, Gr{z) converges to az^ — bz, and hence, Ar converges 
to A given by (2.4). 



4.6. Multitype branching processes. We now consider a branching parti- 
cle system with m possible types, 5 = {1, 2, ... , m}. We assume that a parti- 
cle of type Ci ^ S gives birth to a particle of type C2 S 5 at rate ra(''^(Ci, C2) 
and dies at rate ra^ (Ci) - b^'^HCi), where a^fCi) = Eje5aW(Ci,i). 

The fact that the ordered representations constructed for the previous 
examples give the correct measure- valued processes depends on the fact that 
observing a birth event in the measure-valued process gives no information 
about the levels of the particles after the birth event. That, in turn, depends 
on the offspring being indistinguishable from the parent. Since in the current 
model, the type of an offspring may differ from the type of the parent, we 
need to find a way to "preserve ignorance" about the levels when the type 
of the offspring is different. We accomplish this goal by randomizing the 
assignment of the parent and offspring to the original level of the parent 
and a new level. Let /(C,n,n) be of the form 

n 

f{C,u,n)=Y{g{Ci,Ui). 

i=l 

Then the generator of the ordered representation of the branching process 
described above is given by 

Arf{C,u,n) 

n 

= /(C,n,n)J]J^2aW(0,j) 

i=i jes 

'1 / g{Ci,Ui)g{j,v) + g{Ci,v)g{j,Ui) 



X 



Ui 



2v g{Ci,Ui 



dv 



+ /(C, u, n) [a« {Qui - 6« {Qu,\ ^-^i^, 
where as before, each level satisfies 



POISSON REPRESENTATIONS 31 

Let Q^^^h{C) = X]je5'^^''H^'-?)[^(-?) ~ ^(01- Because of the randomization of 
the level assignments at each birth event, it follows that 

h{Xi{t)) - [\r - Ui{s))Q^'-^h{X,{s)) ds 



is a martingale. 

Taking ar{n,du) as before, we have that 



ArfiC, u, n)a{n, du) = Crf{C, n) 



f{C,n)^^ra^'\Ci,mj)-l] 
i=i jes 



+ /(C,n)5^[ra«(0)-6(^)(0 

i=l 



5(C0 



1 



where f{C,n) = ]Xi=i9{Ci) and g{Ci) = g{Ci,v)dv. Hence, Crf{C,n) is 
the generator of a multitype branching process. 
Assume that 

a{C,j)= limaW(C,j), 

r— >oo 

a(C)= lim aM(C)=J]a(C,j), 
6(0= lim 6M(C) 

r— >oo 

and that 

Qh(C) = Y.a{C,j)[h{j)-h{0] 

is the generator of an irreducible, finite state Markov chain. Let vr denote 
the unique stationary distribution for Q. It is clear from the ergodicity of 
the Markov chain that in the limit, the levels must satisfy 

^U,{t) = aUht)-m{t), 

where a = Y,j T^{j)a{j) and b = J2j t^U)KJ)- 

We can make this observation precise by analyzing the asymptotic behav- 
ior of the generator. Taking g{C,u) = exp(— /io(u) + ^h{(,u)), where h{C,,u) 
and /iQ (u) are equal to zero if u>Ug, and letting r — )• oo , we have that 

lim f{C,u) = lim exp ( - /lo(ui) + - S^ h{Ci,Ui)] 
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= exp f - ^ ho{ui) ] = J{u) 

i 

and since 

9{C.hUi)g{j,v) + g{Chv)9{3,Ui) 

— Q-ho{v) (^^r^^h{j,v) _|_ ^r^'^{h{Ci,v)+h{j,Ui)-h{C,i,Ui))^ 

lim Arf{Q,u) 



(4.11) 



f{u)Y,\2a{Q r[e~''<>(-^-l]dv 

+ ^o,{Ci,j)[h{j,Ui) - h{Ci,Ui) 
j&s 



- [aiCi)ui - KCi)ui] du,ho{ui) 

If X^vr(j)G(j,u) = for all u, then there exists h such that 
Y,<C.j)[Khu)-h{C,u)]=G{C,u). 

Consequently, there exists h such that the right-hand side of (4.11) becomes 
AJiu) = J{u) ^ 1 2a [e-'^«(^) -l\dv- [anf - bm] /io(n,) | , 

which is just a rewriting of (2.4), and hence we have convergence of the 
normalized total population to the Feller diffusion. 

For earlier work, see [14, 25, 29] and Section 9.2 of [9]. 

4.7. Models with catastrophic death. Now consider 

A fi \ ft .^Bg{xi,Ui) 

Arf (x, u,n) = f [x, u,n)} — — 

^ g{xi,Ui) 

+ f{x,u,n)^2a{xi) / {g{. 

(4.12) 



Xi,v) — 1) dv 



+ f{x, u, n) y^{a{xi)u^i - b{xi)ui) — — ^ 

+ / ifix,c{u,x,v),n)-f{x,u,n))'y{dv), 
Jv 
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where 7 is a cj-finite measure on a measurable space {V,V), 

C{U,X,V) = {uip{xi,v),U2p{x2,v), . . .) 

and p{xi,v) > 1. Then as in Section 3.1 



n n 



Crf{x,n) = ^B^J{x,n) + ^ra{xi){f{b{x\xi),n+l) - f{x,n)) 



i=l i=l 



n 



+ ^{fO'ixi) - b{xi))(f{d{x\xi),n- 1) - f{x,n)) 



i=l 



+ / {Yl{p^Hxi,v)g{xi) + {l-p^\xi,v)))-f{x,n)U{dv) 




.i=l 



For simphcity, assume that ^{V) < 00. Then at rate j{V) an event occurs 
in which an element v is selected from V, and given v, particles are inde- 
pendently killed, with the probability that a particle at Xj survives being 
p-^{xi,v). 

Letting r — ?• 00 to obtain A and integrating, 



Branching processes with catastrophes have been considered in a series of 
papers by Pakes [41-46] and by Grey [15]. 



A.l. Poisson random measures. Let {S,S) be a measurable space, and 
let be a cj-finite measure on 5. ^ is a Poisson random measure with mean 
measure v if: 

(a) ^ is a random counting measure on S; 

(b) for each A & S with i^(^) < 00, ^(^4) is Poisson distributed with param- 
eter i^{A); 

(c) for Ai, A2, . . . £ S disjoint, ^(^i),^(^2); • • • are independent. 

Lemma A.l. IfH:S^So is Borel measurable and ^{A) = ^{H~^ (A)) , 
then ^ is a Poisson random measure on Sq with mean measure u given by 




+ / (exp{-(p {■,v)h,p)] -ex.-p{-{h,p)])-^{dv) 



V 



cm. 
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d{A) = v{H" 
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Remark A. 2. D need not be u-finite even if v is, but the meaning of 
the lemma should still be clear, cj-finite or not, I'iA) = oo if and only if 
S.{A) = oo a.s. 

Proof of Lemma A.l. The lemma follows from the fact that ^1,^2, •• • 
disjoint implies H"^ (Ai) , H^^ {A2) , ■ ■ ■ are disjoint. □ 

Lemma A.S. If is a Poisson random measure with mean measure v 
and f G L^{v), then 



(A.l) £;[e//W€(^-)]=e/(<='-l)'^^ 



(A.2) E 



fizndz) 



fdv, 



Var 



f{z)i{dz] 



fdu, 



allowing 00 = 00. 

Letting ^ = Y^,.6zi, for g >0 with log g e L^{iy), 



E 



\{9{Z^) 



Similarly, if hg,g — 1 G L^iy), then 



E 



Y,KZ,)\[g{Z,) 



J{9-l)du 



and 



E 



Y,h{Z^)h{Zj)J{g{Zk 

i^j k 



hgdu] e^^3-i)du_ 



Proof. The independence properties of ^ imply (A.l) for simple func- 
tions. The general case follows by approximation. The other identities follow 
in a similar manner. Note that the integrability of the random variables in 
the expectations above can be verified by replacing g hy {\g\ A a)!^ + 1a<= 
and h by {\h\ A a)l^ for < a < 00 and I'iA) < 00 and passing to the limit 
as a — )• 00 and A E. □ 



Lemma A. 4. //^o = '^i^Ui "is a Poisson random measure on [0,oo) with 
mean measure A/1, A Lebesgue measure, and {Xi} are i.i.d. positive random 
variables, independent of £,q, then 



Ui) 



is a Poisson random measure on [0,oo)^ with mean measure Xfix x A, were 
fix is the law of Xi . 
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If K = E[x-] < oo, then 

is a Poisson random measure on [0,oo) with mean measure XkA. 

Proof. By Lemma A.l, ^ is a Poisson random measure with mean 
measure given by 

POO 

u[0,c\ = Xnx X A{{x,u):xu<c} = X / P{X^^ > uc^^} du 

Jo 

= XcE[X-^]. □ 

A. 2. Conditionally Poisson systems. We begin by considering general 
conditionally Poisson systems or Cox processes. Consider (S, d) a metric 
space, and let ^ be a random counting measure on 5 and H be a locally 
finite random measure on S. [A measure on S* is locally finite if for each 
X £ S, there exists an e > such that i'{B^{x)) < oo.] We say that ^ is 
conditionally Poisson with Cox measure H if, conditioned on H, ^ is a Poisson 
random measure with mean measure H. This requirement is equivalent to 

for all nonnegative / € M{S), where M{S) is the set of all Borel measurable 
functions on S. Since the collection of functions Ff{ij) = e~ ■l^sf'^t^ is closed 
under multiplication and separates points in the space of locally finite mea- 
sures, the distribution of H determines the distribution of S,. 

We are actually interested in the conditionally Poisson system on 5 x 
[0,oo) with Cox measure 'E x A, where A is Lebesgue measure. Then for 
nonnegative / E M{S), we have 

E[e~ ^s^lo,K]f = E[e-^ fs(^-^-^)'i% 

and the distribution of ^ determines the distribution of H, where we con- 
sider / G M{S) to be a function on S x [0,K] satisfying f{x,u) = f{x). In 
particular, 

E{f)=lim^[ fdi a.s. 

Lemma A. 5. Suppose is a conditionally Poisson random measure on 
S X [0, oo) with Cox measure E x A, and let f G M{S), < / < 1. Then for 
C,D>0, 

(A.3) p\ [ fd^>c\<^ + p\ [ fdE>D] 

Ijsx[o,k] ) VJs ) 
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and 

E\l - e"'^~^-^sx[o,K]/'^?l 



(A.4) P fdE>C}< 



Let € A} be a collection of conditionally Poisson random measures 

on S X [0, oo) with Cox measures Hq, x A, and let f & M (S), < / < 1. Then 
^Isx [0 K] f ^^a,ct S .4} is stochastically bounded if and only if {f^ f dEa, a G 
A} is stochastically bounded. 

Proof. Since E[Jg^^^^ j^^fd^\E]=KfgfdE, 

, KLfdE KD 



P{ / fd^>C 

ISx[0,K] 



and taking expectations gives (A. 3). 
By (A.l) 

>(l-e-"^^"'^)p| / fdE>C 



and taking e = C ^ gives (A.4). 

The final statement follows from the two inequalities. □ 

Let ^ = X] be a point process on S, and let {Ui} be independent ran- 
dom variables, uniformly distributed on [0,r] and independent of ^. Define 

(A.5) ^ = Y^S^x^,u.), ^r = r-'l 

Then for / > on S" x [0, r], 

(A.6) E[e^^s.io,r]f^lE^^ = ^(^r~' l\-fix.,u)^^^^^-f,^ 
where 

Fj{x) = -r log ^ e--^(^'") du = -r log (^1 - ^ j\l - e^^(^'"V^^ 

We have the following analog of Lemma A.5. 

Lemma A. 6. Suppose ^ and Er are given by (A.5), and let f € M[S), 
< / < 1. Then for C,D>0 and K <r, 

(A.7) p\ [ fdC>c]<^ + pl [ fdEr>D 

lJsx[0,K] ) Us 
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and 
(A.8 



E\l-e 



SxlO,K] - 



1 - e 



-Ke-C- 



Proof. Since E[Jg,^p..fd(,\Er]=K JgfdEr, 



P< I fdi>C 

ISx[0,K] 



K LfdEr ^ , ^KD 



C 



c 



and taking expectations gives (A. 7). 
Defining 



by (A.6) 



> (1 _ ^-eKe-^C 

and taking e = gives (A.8). □ 



)P\ IJdEr>C}, 



Lemma A. 7. Suppose ^ is a conditionally Poisson random measure on 
S X [0,oo) with Cox measure E x A. If E{S) < oo a.s., then we can write 
C = Yl'^i ^{Xi,Ui) Ui <U2 < • ■ • a.s. and {Xi} exchangeable. 

Proof. Let {Xi} be exchangeable with de Finetti measure -py , and let 
y be a unit Poisson process with jump times {Si} independent of of {Xi} 
and E. Define ^ = YliLi \x- )' ^^"^ wte that 



E 

■ E 
E 



n 



E\-'E{dz] 



exp<; - / I 1 - / e 



exp 



n-^\^r'^)\E\-'E{dz)]ds 
(l_e-/{-."))H(dz)dtx 
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Consequently, is conditionally Poisson with Cox measure 3x A, and ^ and 
^ have the same distribution. □ 

As in Lemma A. 4, we have the following. 

Lemma A.S. Suppose ^ is a conditionally Poisson random measure on 
S X [0,00)^ with Cox measure 'E x A, where 'E is a random measure on 
S X [0,00). Suppose 

E{A)= / -lA{x)E{dx X dy) 

Jsx[o,oo) y 

defines a locally finite random measure on S. Then writing ^ = - S(^Xi,Yi,Ui)> 
£, = '^iS{Xi,YiUi) 0, conditionally Poisson random measure on S x [0,oo) 
with Cox measure E x A, and hence 

I y^^fix)E{dx X dy) = E{f) = lim ^ / /df a.s. 

Jsx[0,oo) ^^"^ J Sx[0,K] 

A.3. Convergence results. Let {hk,k = 1, 2, . . .} C C{S) satisfy < /i^ < 
1 and Ufe{^-^fc(^) > 0} = 5', where C{S) denotes the space of bounded 
continuous functions on S, and let M^)i^^{S) be the collection of Borel mea- 
sures on S satisfying J^kkdiy < 00, for all k, topologized by the requirement 
that Vn — )• z/ if and only if fh^dun — )■ J^fh^dv for all / G C{S) and k; 
that is, the measures dv^ = hf^dun converge weakly for each k. Similarly, 
let A^|/ij.}(5' X [0,00)) be the space of Borel measures on 5 x [0,oo) satis- 
fying p /ifc d// < 00 for all k = 1,2, . . . and K > 0, topologized by the 
requirement that if and only if 

/ fhk dun / fhk dfi, 

JSx[0,oo) JSx[0,oo) 

for all k and / G C{S x [0, 00)) such that the support of / is contained in 
5 X [0, K] for some K > 0. Note that in both cases, Ai^^^y is metrizable. To 
simplify notation, let 

C^fi^,j{S) = {/ G C{S) : I/I < c/ifc for some c> and hk}- 

Then convergence in A^|/j^|(5) is equivalent to convergence of f dvn for 
all/GC|;,,,}(S). 

Theorem A. 9. Let {^"j be a sequence of conditionally Poisson ran- 
dom measures on S x [0, 00) with Cox measures {H" x A}. Then =^ C in 
-^{hk}i^ X [0,00)) if and only i/ =^ H in ^A^ll^y{S). If the limit holds, 
then ^ is conditionally Poisson with Cox measure E x A. 
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Proof. Suppose ^" ^ ^ in Mi^hk}{S ^ [0,oo)). Then for each / G C{S), 
/ > 0, each k, and ah but countably many K 



n— >oo 
n— >oo 

For g>0 and K satisfying sup^, K~^g{x)hk{x) < 1, let 

f(^\ ^ / -K^ix) log(l - K-^g{x)hk{x)), hk{x) > 0, 
' \k-'9{x), hkix) = 0, 

and we see that 

hm E[e- -^sdhkdE"^^ -^^^^ Js^io,K]fhkdii^ 

n— >oo 

exists. Since ^'^ =^ in A4^fn:}{S x [0,oo)), {/^xpi^r] ^kd^"'} is stochastically 
bounded and by Lemma A. 5, {J hf.dS'^} must be stochastically bounded. 
Tightness follows similarly. Consequently, {H"} is relatively compact in 
M.^in,j{S) in distribution, and the unique limit H is determined by the fact 
that 

for g and / related as above. The proof of the converse is similar. □ 

Theorem A. 10. For each n = 1,2,..., let rn > and ^"^ be a point 
process on S x [0,r.„], and define 

(A.9) = —C(dx X [0,r„l). 

rn 

Suppose for / > 0, ^[e-//(^.«)?"('^^x'^«)] = ^[e-/^7(^)^"('^^)], where 
FJ{x) = -rn\og— e-^(^'")du = -r„log 1 / (1 - e-^(^'")) , 

J^n Jo \ fn Jo J 

that is, the [0,rn\ components are independent, uniformly distributed, and 
independent ofHT". Then assuming rn — )• oo, ■C" ^ in M.i^h^y{S x [0, oo)) if 
and only if in A4^h^y{S). If the limit holds, then ^ is conditionally 

Poisson with Cox measure H x Tl. 

Proof. For goJo > 0, 50 G Cc([0,oo)), /o S C(S') and f{x,u) = hk{x) x 
fo{x)gQ{u), FJ{x) — )■ /q°°(1 — e"'^'^^'")) du, and the remainder of the proof is 
similar to that of Theorem A.9. □ 
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These convergence theorems apply only to the one-dimensional distribu- 
tions of the models considered in this paper. To address convergence as pro- 
cesses, note that for finite r and 'Er{t,dx) = r~^^{t,dx x [0,r]), the models 
satisfy 



(A.IO) 
where 



-r log ■ 



-rlog 1 



(l_e-/(^,"))d^ 



and the r = oo models satisfy 



(A.ll) 



]7;\q /sx[o,k] 



for / G C^i^^y{S). The following estimates imply that convergence of the 
finite-dimensional distributions for ^"^ imply convergence of the finite-dimen- 
sional distributions for (or H"^, assuming r„ — >• oo); however, convergence 
of the finite-dimensional distributions of may not imply convergence of 
the finite-dimensional distributions of of S,^. 



Lemma A.ll. Suppose ^ is a conditionally Poisson random measure on 
S X [0,00) with Cox measure H x 71, H with values in Ms^h^^{S). Then for 
each f £ C^h^j (5) and 5, K, K' > 0, 



Sx[0,K] 



>6 



(A.12) 



< 



C 



+ P{ / fdE>C 



C E\l-e 
< ^ + ^ 



Sx[o,i<:'l 



K6^ 



1 



Suppose ^ satisfies (A.IO). Then for each f G C|/j^}.(S'), (5 > and Q <K , 
K' <r 



P 



(A.13) 



K 



< 



< 



'Sx[0,K] 

{r-K)C 



+ P 



fdEr 



>6 



f^dEr>C 



{r-K)C E[l-e~'^ '/sx[o,if'] 



+ 



-K'e-C- 
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Proof. By (A. 2) and the Chebyshev inequality, 



P 



I fdi- I fdE 

Sx[0,K] 



>6 



. JfdE C 



and taking expectations gives the first inequality in (A. 12). The second 
inequality follows by (A. 4). 
Similarly, for the second part. 



P 



Sx[0,K] 



>6 



r{l-K/r)p dEr 
- rKS^ +l{//2dH,>C7}, 



and taking expectations gives the first inequality in (A. 13). The second 
inequality follows by (A. 8). □ 

The estimates in Lemma A. 11 allow verifying convergence of measure- 
valued processes satisfying (A. 11) or (A. 10) by verifying convergence of the 
corresponding particle representations. 

Theorem A. 12. Let {^"} he a sequence of cadlag Ms^h,,}{S x [0,oo))- 
valued processes satisfying (A. 11) for cadlag Mj^h^^{S) -valued processes {H"}. 
If the finite- dimensional distrihutions of(,^ converge to the finite- dimensional 
distrihutions of ^, then the finite- dimensional distrihutions of E^ converge 
to the finite- dimensional distrihutions of E satisfying 

^[e-/sx[O.K] I J-H] = g-i^/g(l-e-/)dS(t)_ 

For n = 1,2, ... , let he a cadlag Ai^f^^j{S x [0,rn]) -valued process sat- 
isfying (A. 10) for cadlag Ai^^^^[S) -valued processes {E"^^}. //r„ — )■ oo and 
the finite- dimensional distrihutions of ^"^ converge to the finite- dimensional 
distrihutions of then the finite- dimensional distrihutions of E^^ converge 
to the finite- dimensional distrihutions of E satisfying 

E[e~ /sx[o,x] /'^«(*) I jf] = e-Kfsii-e-f) dm . 

Proof. Convergence of the finite-dimensional distributions follows eas- 
ily from the estimates in Lemma A.ll. □ 

A.4. Martingale lemmas. 

Lemma A. 13. Let {Tt} and {Qt} he filtrations with Qt <Z J-t- Suppose 
that E[\X{t)\ + /q \Y{s)\ ds] < oo for each t, and 



M{t) = X{t)- I Y{s)ds 
Jo 
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is an {Ft} -martingale. Then 

M{t)=E[X{t)\gt] 

is a {Qt} -martingale. 

Proof. Let DGGtCTt. Then 
E[{Mit + r)-M{t))lD] 

= E 

= E 
= 0, 



E[Y{s)\gs]ds 



t+r 



E[X{t + r)\gt+r] - E[X{t)\gt] - E[Y{s)\gs] ds ) Id 
{x{t + r) - X{t) - j^^ Y{s) ds^ 1, 



giving the martingale property. □ 

Lemma A. 14. Let {J-n} o-n increasing sequence of a -algebras and 
{Xn} a sequence of random variables satisfying £'[sup„|X„|] < oo and 
\\mn^^Xn = X a.s. Then 



lim E[Xn\Fn] =E 



x\\lFn 



Proof. By the martingale convergence theorem, we have 



E 



inf xA\lFn 

k>m I ' 



< liminf < limsupS[X„| < E 



sup 

k>m ' „ 



and the result follows by letting m — )• oo. □ 



A.S. Markov mapping theorem. The following theorem (extending Corol- 
lary 3.5 from [30]) plays an essential role in justifying the particle repre- 
sentations and can also be used to prove uniqueness for the correspond- 
ing measure-valued processes. Let {S,d) and (5*0, c?o) be complete, separable 
metric spaces, B(S) C M(S) be the Banach space of bounded measurable 
functions on 5, with ||/|| = sup^^g\f{x)\ and C{S) C B{S) be the subspace 
of bounded continuous functions. An operator A C B(S) x B{S) is dissipa- 
tive if ll/i -/2 -e(5i -52)11 > ||/i - /2II for ah (/i, c/i), (/2,52) G ^ and e > 0; 
^ is a pre-generator if A is dissipative and there are sequences of functions 
(in'-S ^ V{S) and A„ : iS — )■ [0, 00) such that for each (/, g) G A 



(A.14) 



g{x)= lim A„(x) / {f {y) - f [x)) fXnix , dy) 
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for each x £ S. A is graph separable if there exists a countable subset {gk} C 
P(^) r\C{S) such that the graph of A is contained in the bounded, pointwise 
closure of the linear span of {{gk,Agk)}. [More precisely, we should say that 
there exists {{gk,hk)} C An C{S) x B{S) such that A is contained in the 
bounded pointwise closure of {(gfcj^fc)}; but typically A is single- valued, so 
we use the more intuitive notation Agk-] These two conditions are satisfied by 
essentially all operators A that might reasonably be thought to be generators 
of Markov processes. Note that A is graph separable A C L x L, where 
L C B{S) is separable in the sup norm topology, for example, if S is locally 
compact, and L is the space of continuous functions vanishing at infinity. 

A collection of functions D C C{S) is separating if i^, G T^iS) and f dv = 

f dj-L for all / G imply ^ = u. 

For an 5o-valued, measurable process Y , TJ will denote the completion 
of the cr-algebra (T(y(0),/Q h{Y(^sy)ds^r <t,h£ B{So)). For almost every 

t, Y{t) will be J-"^^-measurable, but in general, J-^ does not contain J^Y — 
a{Y{s) ■.s<t). Let = {t : Y{t) is J^Y measurable}. If Y is cadlag and has 
no fixed points of discontinuity [i.e., for every t, Y{t) =Y{t—) a.s.], then 
= [0,00). Ds[0,oo) denotes the space of cadlag, S'-valued functions with 
the Skorohod topology, and Ms[0, 00) denotes the space of Borel measurable 
functions, x : [0, 00) — )■ S, topologized by convergence in Lebesgue measure. 

Theorem A. 15. Let {S,d) and (5o,(io) bs complete, separable metric 
spaces. Let A C C{S) x C{S) and ip G C{S), Tp > 1. Suppose that for each 
f G L)(A) there exists Cf > such that 

(A.15) \Af{x)\<Cfij{x), xgA, 

and define AQf{x) = Af{x)/ip{x). 

Suppose that Aq is a graph- separable pre- generator, and suppose that 
T>{A) = T>{Aq) is closed under multiplication and is separating. Let 7:6'— t- 
5*0 be Borel measurable, and let a be a transition function from Sq into S 
[y £ Sq^ a{y, •) G 'P(-S') is Borel measurable] satisfying J ho ^[z)a{y, dz) = 

h{y), y G Sq, h G B{So), that is, a{y,^~^{y)) = 1. Assume that ip{y) = 
Jgijj{z)a{y,dz) < 00 for each y £ Sq, and define 

C = I f{z)a{;dz), Af{z)a{;dz)^ : / G V{A) | . 

Let fiQ £T'{So), and define 1^0 = j a{y,-)fiQ{dy). 

(a) IfY satisfies £ E['ilj{Y{s))]ds < 00 for all t>0, and Y is a solution of 
the martingale problem for {C,fiQ), then there exists a solution X of the 
martingale problem for (A, vq) such that Y has the same distribution on 
Msg[0,oo) as y = 70 X. LfY and Y are cadlag, then Y and Y have the 
same distribution on Dsq[0,oo). 
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(b) ForteT^, 

(A.16) Gr|jf } = a(y(t),r), TGBiS). 

(c) If, in addition, uniqueness holds for the martingale problem for (yl, z^q)? 
then uniqueness holds for the Msq [0, oo) -martingale problem for (C, no) . 
If Y has sample paths in Dso[0,oo) , then uniqueness holds for the 
Dso[0,oo) -martingale problem for {C,fio). 

(d) If uniqueness holds for the martingale problem for {AjVq), then Y re- 
stricted to is a Markov process. 

Remark A.16. Theorem A. 15 can be extended to cover a large class of 
generators whose range contains discontinuous functions. (See [30], Corollary 
3.5 and Theorem 2.7.) In particular, suppose Ai, . . . , Am satisfy the condi- 
tions of Theorem A. 15 for a common domain D = T>{Ai) = ■ ■ ■ = D(^Am), 
and /3i, . . . , Pm are nonnegative functions in M[S). Then the conclusions of 
Theorem A. 15 hold for 

Af = PiAif + --- + PmAmf. 

Proof of Theorem A. 15. Theorem 3.2 of [30] can be extended to 
operators satisfying (A. 15) by applying Corollary 1.12 of [34] (with the op- 
erator B in that corollary set equal zero) in place of Theorem 2.6 of [30]. 
Alternatively, see Corollary 3.3 of [32]. □ 

A. 6. Uniqueness for martingale problems. Assume that B C C{E) x 
C{E), that P(i?) is closed under multiplication and is separating, and 
that existence and uniqueness hold for the De[0,oo) martingale problem 
for {B,v) for each initial distribution u € V{E). Without loss of generality, 
we can assume g G T>{B) satisfies < < 1. 

By Theorem 4.10.1 of [9], existence and uniqueness then follows for the 
n-particle motion martingale problem with generator 

(A.17) B- = I l^fix), fix) : /(x) = n g{xO | . 

Actually, the cited theorem implies uniqueness for the ordered n-particle 
motion with generator 

5" = ( (fix), fix) j2 ■■ fix) = fl9.ix.),9^ G V{B) 

[ \ i=i 3^^^^> ) i=\ 

but Theorem A. 15 can be applied to obtain uniqueness for B^ from unique- 
ness for B^ . Define 7(x) = Y^=\^x^ and let a{y,-) average over all permu- 
tations of the Xi in y = "^^^i ■ 
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Now consider a generator for a process with state space 



n K. 1=1 



where we allow n = 0, that is, no particles exist. 
For /(x,n) =nr=i5(a^i)> let 



A/(x,n) = i?"/(x,n) 

+ fix,n)YXkix) / [Ylg{zi)-l\r]k{x,dzi,...,dzk) 

k •'^'^ \i=i J 

+ f{x,n) V fx{x,zi,...,zi)(—i-^ 



{z-i,...,zi)c{xi,...,x„} 



where , ;U > and rjk is a transition function from S to ii^'^ . The generator 
has the following simple interpretation: in between birth and death events 
the particles move independently with motion determined by B. At rate 
Afc(x), k new particles are created with locations in E determined by At 
rate fi{x, zi, . . . ,zi), the particles at zi, . . . ,zi are removed. 
Let 

= 'YXk{x) + ^ fj,{x,zi,...,zi). 

k {zi,...,Zi)C{xi,...,Xn} 

Then for each initial distribution i/q and each m > 0, a localization argument 
and Theorem 4.10.3 of [9] imply existence and uniqueness of the martingale 
problem for (yl, fo) up to the first time the solution leaves {x:(3{x) < m}. 
Consequently, existence and uniqueness hold provided that there is a solution 
X satisfying sup 13 {X{s)) < oo a.s. for each t> 0. 

Essentially the same argument gives existence and uniqueness for gener- 
ators of the form (3.1) provided inf3;(a(2;)r — b{x)) > and there exists a 
solution satisfying sup^<^ ^ a(Xj(s)) < oo a.s. for each t > 0. 
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